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A hybrid digital transmission system consists of analog repeaters placed 
between digital repeaters. Joint optimization of the analog and digital 
repeaters is considered in this paper, using minimum mean-square error 
between the transmitted and received symbols as the performance criterion. 
A general hybrid system is considered. The joint optimization problem is 
solved in closed form for deterministic sampling under two usually satisfied 
conditions. From the results the minimum mean-square error and the 
optimum repeater characteristics can be computed for given system pa- 
rameters. Timing error is also considered. From a general result, it is 
concluded that in many practical systems it is not only economical, but 
also optimum, to use identical analog repeaters, and that hybrid systems 
can be used for either digital or voice transmission with no compromise in 
theoretical performance. 

I. INTRODUCTION 

It is customary in long-haul digital transmission systems to regen- 
erate the digital signal at each point that gain is introduced into the 
system. This is not necessary, however, and in fact there are circum- 
stances in which it is advantageous to do otherwise. One such cir- 
cumstance occurs when multilevel pulses are being transmitted and 
the associated digital repeater* is too complicated and costly to be 
placed at every gain point. In this case there is merit in interspersing 
a number of analog repeaters between digital repeaters, even though 
the digital device must usually be complicated further by the intro- 
duction of automatic equalization to compensate for the misalign- 
ment which accrues over several analog links in tandem. 



* A digital repeater is also called a regenerative repeater, 1 a reconstructive 
repeater, or a regenerator. 
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Part I of this study addresses itself to the problem of jointly op- 
timizing the various filters contained in a combination analog-digital 
or "hybrid" multilevel transmission system. The criterion used is 
minimizing the mean-square error between transmitted and received 
symbols. The system studied is general in that: (i) the repeater spac- 
ing may be nonuniform and the transfer functions of the transmission 
media may be different, (ii) the noises introduced by the repeaters 
may not be white and each may have a different spectral density 
{Hi) the analog repeaters are not constrained to be identical, and 
(iv) the repeater output power levels are not constrained to be the 
same. 

The mathematical model is formed in Section II. Results are sum- 
marized in the concluding section. Interesting characteristics and 
potentialities of hybrid cable systems are explored in Part II. 2 

II. MATHEMATICAL MODEL 

Figure 1 illustrates a general hybrid digital transmission system. 
Information symbols {a,k} are transmitted from one digital repeater 
to the next through L analog repeaters. The output network of the 
sending digital repeater is referred to as the transmitting filter with 
transfer function J5 (/). The input network of the receiving digital 
repeater is referred to as the receiving filter with transfer function 
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Fig. 1 — A general hybrid digital transmission system. 
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Bl+iU)- The transfer function of the ith analog repeater is denoted 
Bi(f), i = 1, ..., L. In this paper the analog repeaters are not con- 
strained to be identical; hence, the ratio J3 ( (/)/.B,(/) may be a function 
of frequency. The noise at the input of the ith analog repeater has a 
spectral density Ni(f) , i = 1, . . . , L. The noise at the digital repeater 
input has a spectral density N L+1 (f) . Notice that Ni (/),... , N L +i(f) 
may be all different and each may be a function of frequency. 

As shown in Fig. 1, the transfer functions of the transmission 
media between the repeaters are denoted by A {f), A 1 (f), . . . , and 
A L {j) . These transfer functions may be all different; hence, the 
repeater spacings may be nonuniform, and the transmission media 
may be different. 

The average output signal power of the transmitting filter is con- 
strained to be P . The average output signal power of the ith analog 
repeater is constrained to be P„ i = 1, . . . ,L. 

The information symbols {a k } are multilevel digits or real num- 
bers. It is assumed that {a k } is stationary in the wide sense. The 
autocorrelation function is denoted by 

m k = E[aia [+k ], I, k = — «>, • • • , <». 

Pulse amplitude modulation is considered. Let 1/T be the baud 
rate. The transmitting filter output is then 

£ a k s(t - kT) 

ft— 00 

where s(t) is the impulse response of the transmitting filter. 

As is well known, in linear PAM systems the receiving filter output, 
X(t) in Fig. 1, is sampled sequentially at T-second intervals, and 
the fcth time sample b ]c is used as an estimate of a k . For analytical 
purposes, a constant time delay in the system may be neglected, and 
it may be assumed that b k is taken at 

t = kT + 8 h 

where 8 k is the timing jitter. 3 

The system from the output of B (f) to the input of B L+1 (f) may 
be considered as a channel. For a given channel, Berger, Tufts, and 
Smith 4, 5 have considered methods for designing the transmitting and 
receiving filters for minimizing the mean-square error E[(b k — a k ) 2 ]. 
By these methods the digital repeaters can be specified if the analog 
repeaters were given, and their output powers were not constrained. 
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In this paper, the analog repeaters are to be designed, and their 
output powers are constrained. We consider joint optimization of the 
analog and digital repeaters. For given L, N t {f) , i = 1, . . . , L + 1, 
Aj(f), j = 0, . . . , L, {m k }, and T, we wish to design B k (t), k = 0, 
1, . . . , L + 1, jointly to minimize the mean-square error 

£ = E[(b k - O 2 ] (1) 

subject to the constraints of fixed repeater output signal power P,-, 
i = 0, ■ • ■ , L. 

The letter E in (1) denotes the ensemble average taken over {a k ), 
8 k , and the noise. The Fourier transform of the probability density 
function of 8 k is denoted by P(/). The notation "*" denotes a complex 
conjugate and "| -|" denotes a magnitude. 

By a well known method, 4 the mean-square error in (1) can be 
expressed as 

+ Z r NM I II Mf)B<(1) f df (2) 



where 



M(f) = m + 2 X) m k cos 2irjkT 



is the spectral density of the stationary, random message sequence 

{a k }. 

By introducing the dummy variable ^_i(/) = 1 for all /, we can 
write the repeater average output signal powers all in the same form as 



p.-ifjf^ n am-ub,® 

1 J -a, 1—1 i=0 



dj, I = 0, 1 , • • ■ , L. (3) 



III. NECESSARY AND SUFFICIENT CONDITIONS 

Necessary and sufficient conditions for B„(f), n = 0,1, • • ■ , L + 1, 
to minimize the mean-square error 8 can be derived by using the 
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standard techniques of the calculus of variations. These conditions 
are rather lengthy. In order to conserve space and to facilitate the fol- 
lowing manipulations, we write these conditions in the same form. 
To do so we use the dummy variables 

.-!_,(/) = 1 for all / 

A L+1 (j) = 1 for all / 

X £+1 = 0. 

Then it can be shown that the necessary and sufficient condition for 
£„(/), n = 0, 1, • • • , L -f- 1, to minimize the mean-square error 8 
subject to the power constraints in (3) is 



^(/)[n^?(/)][n/?(/)]^ 



if* 



z^a^-iWf- 1 - 



T 



T 



_ x-0 _ - j-0 J 



+ Z Wtf) 

1-0 I. 
L + l ( 1 

+ £ |x, | M(f) 

where \ h I = 0, . . 



EU.(/)-n #,-(/) B n (f, 






II AM-UBM B n (1)\ = for all/ (4) 

i — 1 )=0 I ) 

, L, are Lagrange multipliers. The definition 



Ub,® 






= i 



is used in (4). 

In the following sections, we consider the problem of determining 
the optimum B n (f),n = 0, 1, . . . , L + 1, from equations (2) to (4). 

We can eliminate a trivial case first. In some correlation schemes 
(such as duobinary) M{f) may be zero at some frequencies. It can 
be shown that B L+1 (j) must be zero at the frequencies where M(f) = 0. 
Furthermore, £,,(/), n = 0, 1, • • • , L, can be arbitrarily chosen at these 
frequencies without affecting the mean-square error 8. In practice, they 
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may be chosen so that their amplitude and phases are continuous at 
these frequencies. 

In the following sections M(j) j£ is assumed. Furthermore, as is 
always the case in practice, iV,(/), A ,-(/), P t , and T are assumed to be 
nonzero, finite quantities. 

IV. GENERAL RESULTS 

By multiplying equation (4) by B*(j) one obtains 

L + l 

U.BM 



ZWO) HAM 

i-l 

L + \ f -. 

+ g |x« I M(f) 



n ^.(/) 



II #;(/) 



n = 0, 1, 



= KB 

L + 1 



(5) 



where 

f (/) = M/) 



n^n/) 



L + l " I 

nsfd) 

j=0 J 



W-k?. p (l)[n^- 



/ - f )B\f - f 



is not a function of n. It can be shown that we may use equation (5) 
instead of (4) without changing the solutions. 

Letting n = m and m + 1 by turns in equation (5) , one obtains two 
equations. Subtracting the latter from the former gives 



K^M(f) 



= N m+l (f) 



n am 



n am 



Il£y(/) 



1-0 

i + 1 



n b,-u) 



m - 0, 1, ••• ,L. (6) 



Since the right-hand side of equation (6) cannot be zero for all /, one 
has \ m > 0, m = 0, . . . , L. From equation (6) 



\ M 1 A h (j) I 2 | B h+1 (j) | 2 _ 

X fc " N h+l (j) | A h+l (fi | 2 | B h+1 (j) 



N h+2 (f) 



h = 0, 1, ••• , L - 1. 



(7) 



Equation (7) is equivalent to 
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BAD r = 



fx,-, NjjJjj Y L 

_ h ' N,-(j) J | A ,-_,(/) | 



i = 1,2, ••• ,L. (8) 

It can be shown that, regardless of the values of m in equation (6) , 
substituting equation (8) into equation (6) gives 



^ M(f) | A (j) 



K 



_^(/)_ 



B (j) 



. Xr. . 



B L+1 (f) 



From equations (8) and (9) one gets 

II MW.if) | = [^r$J I Mi) I I Bod) I 2 - 
Let us define 6(1) to be the phase of [JYitl A t {f)B t (J)], that is, 



IU .(/)#.(/) = 



n^.(/)^.(/) 



(9) 



(10) 



(11) 



Substituting equations (8), (10), and (11) into equation (5) and 
setting n = 0, one obtains after a few steps 

LriVx(/)_ 



7\~ VF 



A (fi | | J3 (/) r - 



ii i ( - IW/ - 1)] - -p(/) 



+ z 






1 



-iB(f) 



= 0. 



(12) 



. Til/(fl _ | -4,(fl | 

We have shown that the optimum digital and analog repeaters 
must satisfy the L + 2 equations in (8), (9), and (12). Some dis- 
cussion is in order. 

Let us refer to the frequencies at which B„(f) ^ as the transmission 
band. There is no signal transmitted outside this band. Clearly, the 
analog repeaters may have arbitrary amplitude characteristics outside 
the transmission band. Furthermore, the analog repeaters may have 
arbitrary phase characteristics at all frequencies.* Therefore, it is only 



*It is seen from equation (2) that the mean-square error depends on the 
over-all phase characteristic of the system, but not on how the over-all phase is 
distributed among the repeaters. Thus, the analog repeaters may have arbitrary 
phases. The over-all phase can be adjusted at the digital repeaters. 
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necessary to specify their amplitude characteristics in the transmission 
band. Equation (8) shows that, in the transmission band, the jth. 
analog repeater (j = 1, • • • , L) should have an amplitude characteristic 
proportional to the function 



L #,(/) J Li a m m u • 



This simple specification holds regardless of the distribution of timing 
jitter and the spectral density M(f) of the message sequence. Since 
the above function is in general well behaved, and since the phases 
can be arbitrary, the optimum analog repeaters can be closely realized. 
For brevity, we say that several functions are similar when they 
differ only by multiplicative constants. In practice, the repeater noise 
spectral densities may be similar, and the transmission media may 
have similar transfer functions. In such cases, equation (8) shows 
that the amplitude characteristics of the analog repeaters are also 
similar. A rather important physical meaning of this is: 

The use of similar analog repeaters is not only an economical 
choice, but also an optimum one, for systems where the repeater 
noise spectral densities are similar and the transfer functions of 

the transmission media are similar. 

It remains to determine the digital repeaters, the gain constants 
of the analog repeaters (the L 4- 1 LaGrange multipliers), and the 
transmission band. They must satisfy the L + 2 equations in (8), 
(9), and (12), and the L + 1 power constraints in (3). Furthermore, 
as will be shown, they must also satisfy some validity conditions 
because the repeater amplitude characteristics must be nonnegative. 
Since the solution depends on the distribution of timing jitter and 
since it is difficult to cover all cases in one paper, we shall consider 
only the important case of deterministic sampling (that is, the case 
in which timing jitter can be neglected) in the remainder of this 
paper. 

V. DETERMINISTIC SAMPLING 

From now on we consider deterministic sampling, that is, timing 
error h = 0, or 

P(f) = 1, for all /. (13) 

Substituting (13) into (12) and noting that Ao, M(f), T, N t (f), and 
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|A (/)| are nonzero, finite quantities (we consider M(f) = in 
Section III), one can see that joint optimization requires either 



I B (f) | - 



(14) 



or 



1 °° 

■L k--to 



n Mi - £\BAf - 



i'-$\ 



- i 



fa L TMt 



1 



-/«</) 



= 0. 



(15) 



TM(f) J | A t (j) I 
The first term in (15) is a periodic function in / with period 1/T, that 
is, it has the same value at the frequencies / and / — k/T, where k is 
any integer. Hence, a necessary condition for (15) to be satisfied at 
both / and / - k/T is that 



fa _ TM{f) 



t+ i(flT i 

m j i A t \ 



-tun 



(/) 



- E 



hN l+1 [j - y 



™l/-| y 



-iHf-h/T) 



Mf-% 



(16) 



Since M(f) is a periodic function in / with period 1/T, (16) is equiv- 
alent to the set of conditions 



and 



where 



a cos 8(f) = cos d(f - yjj 
a sin 0(f) = sin #(/ - ^J , 



= £ [a,at, +1 (/)]* 



= E 



I A,(fl | 

[x,JV I+l (/ - 1) 



"Allf-f 



(17) 



(18) 



(19) 



(20) 



Noting that a and /3 are positive, one can show that (17) and (18) 
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hold only if 



a = /3 



and 



where 



*(/ - |) = 8(f) + ww t 



(21) 
(22) 



v = any even integer, including zero. 

Thus, (15) can be satisfied at both / and / — k/T only if (21) and 
(22) are satisfied. 
From (11) , (10) , and (22) , one obtains 






44/ - y 



M - D] 



^o(/ — ^ 



Substituting (23) into (15) , one can show that 



Substituting (24) and (23) into (15) gives 



(23) 



(24) 



M(f) Z r 



" 0i/ "^^l4-| 



M-D] 

= T pmq _ r ± 



KN l+l (f) 



fo _ Xo _ I ^l(/) 



1 



(25a) 



The optimum jitter-free system must satisfy either (14) or (25a). 
For convenience, we assume that for each /, (25a) is satisfied at / — m/T 
for m e (ft/ , where 61/ is a set of integers to be determined. The subscript 
/ indicates that (ft/ may vary with /. Clearly (14) must be satisfied at 
f — m/T for m e" (ft r , that is, 



B Q [f-f 



= 0, 



me" (ft/ . 



(26a) 



If (R/ is an empty set, \ B (f — m/T) | must be zero for all m (including 
m = 0). 
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Let us define a frequency set d as 

$ = \j : —^f ^ j ^ yj, and (R, is not an empty setj- 

Clearly, (25a) is satisfied in the frequency set 

g= = [f:f = g — m/T, g e 8 and m t (R„}, 

and (14) must be satisfied for / $ J, that is, 

| B (j) | =0 for / 4 ff. (26b) 

Notice that 5 is the transmission band. Clearly, the transmission band 
can be determined from d and 01/ . 

Substituting (13) into (5), letting n = L + 1, and integrating the 
resulting equation, one obtains 



/a r* l , + 1 

M(D\ II Af(j)Bl 



CO 



k- -oo 



ii i,(/ _!)*,.(/-! 



7/ 

+ e / NM i n ^,(/)5,(/) 2 df = o. 

J=0 «'-« I i = l 

Combining (2), (13), and (27), one gets 

S = mo - f X M(!) ]I A%(j)B%f) 1 <*/. 

•/ — 00 _ i = J 

Substituting (11), (10), and (24) into (28) yields 



- l>df 



(27) 



(28) 



8 = m — 



Mij) 



" M/(/) 1* 
.7W,(/)J 



A (/) | | Bo(/) I 2 d/. (29a) 



Using (26b) and the definitions of 5 and £J, and noting that M(J) is a 
periodic function in / with period 1/T, one can cast (29a) in the form 



& = m 



I 



a M(/) 
T 



M(1) Zr 



^ol/-^ 



NA1~f 



BAI-j, 



df. (29b) 



J 
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Since (25a) is satisfied at / — m/T for m t (R f , one has from (25a) 



Mll-%) £ 



T 



77 *"- [ Ni (j _ »'■ + * 



T 



^(/"^ 



= 7 1 



TM[j - | 



-rl 



J~0 L 



X/A r h -i[/ - 7p 



Xo 



A,l/-f 



B!t(R/. 



(25b) 



By changing the index ra + k to i, using the periodicity of M(f), and 
then using (26a) , one can rewrite (25b) as 





A (/- 


tJ 


#i(/- 


T). 



Bo[1 ~ if, 



= T 



L Xo J 



-n 



\,N l+1 \f - ji 

To 



i 



Ml - f 



ra e (R, . (25c) 



Now we may substitute (25c) into (29b) to obtain 
g = m Q _ j TM(j) df 



+ 



f [TM(f)]>- 



E [x,]* 



Av„l/-f 



AA1-J 



df, mt<R f . (30) 



Equation (30) is the expression of S for the case of deterministic sam- 
pling. 



VI. DETERMINATION OF THE TRANSMISSION BAND 

Let us consider the determination of the frequency set 6 and the 
integer sets (R, . The ratios 
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/ = 0, 



have appeared in the previous equations, such as in (30) . It is obvious 
from Fig. 1 that [A^i (/) ] y V|^o(/) | may be interpreted as the noise- 
to-signal ratio of the first analog link, [N%{f)]*/\A x (f)\ as the 
noise-to-signal ratio of the second analog link, and so on. A similar 
noise-to-signal ratio has*- 5 appeared in optimizing the transmitting 
and receiving filters for a given channel (see Section II). Since such 
noise-to-signal ratios are usually not periodic functions in /, it is 
customary to assume that for any / and k we have either 



I A,{J) I * 



1 4 - 1 



(31) 



or 



I Ai(f) 



r < 



N t . 



1-j 



a{i- 



(32) 



This assumption is valid for most practical cases. 

In the following we assume that (31) or (32) holds simultaneously 
for I — 0, 1, . . . , L. Physically, this means that the pass and attenua- 
tion bands (valleys and peaks of the noise-to-signal ratios) of the 
analog links coincide. Important applications where this assumption 
is valid are considered in Part II of this study. 2 It should be em- 
phasized that this assumption is usually valid because carrier modula- 
tion can and should be used at the analog repeaters to shift the fre- 
quencies so that the pass and attenuation bands of the analog links 
coincide and the transmission media are best used. 

From the above assumption, it is easily seen that 



EM 



i m l ,m i 

I A:(i) | 



* E [x«]* 



N l + l / 



h 



M/-| 



(33) 



for any / and k ^ 0, regardless of the values of the Vs. Comparing 
(33) with (19) to (21), we see that (21) is not satisfied. Therefore, 
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from Section V, (15) and (25a) cannot be satisfied at both / and / — 
k/T for any / and k 7^ 0. Consequently, the set of integers (R, defined 
after (25a) cannot contain more than one element, and (26a) becomes 



= 0, for toeCR, , k 7* 0. (34) 

Substituting (34) into (25b) gives 



M(/)j^M(/)| 2 

= r |~™(/)1* _ T £ [hEi±M~V 

L A n _ 1=0 L X„ J 

From this the transmitting filter is determined as 



Ml) 



/eS. 



1 B (j) r = 



MiS) I Ao(j) I AS 

•{[TM(j)? - ± X| Jj^fj , / e J (35) 



For the solution of the optimization problem to be valid, the solu- 
tions of \Bi{f) I must satisfy the conditions 

|*i(/)| £0, I = 0, 1, ■■■ ,L + 1. 

These conditions can be used to determine the appropriate signs of 
(X,)*, I = 0, • • • , L. Consider first the possibility that (X ) J < 0. It 
can be seen from (8) that (X ) J < and | £,(/) \ 2 ^ 0, I = 1, • • • , L, 
together require 

(A,)* < 0, I = 1, ■• ,L. 

But, from (35) , the conditions 

(X,) 1 < 0, I = 0,1, ■•■ ,L, 
would imply that 

I B (j) | 2 ^ 0, 

which is not a valid solution. Therefore, (X )* cannot be negative and 
must be positive. It can be shown from (35), (8), and (9) that (X )* > 
and I B t (j) | 2 ^ 0, / = 0, • • • , L + 1, together require that* 



* D(f) defined in (36) is an abbreviation used later. 
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D(j) = [TM®]* 



- £x! 



[#,♦,(/ - 



A t \1- 



^ 0, ]zi\ mt(R f (36) 



and that (\ t ) iA > 0, I = 1, . . . , L. From these and the fact that 
(Ao) % must be positive, it is concluded that the solution is valid only 
when (36) is satisfied and 



(X,)* > 0, / = 0, • • • , L. 



(37) 



The necessary conditions in (36) and (37) are used later in determining 
3 and (R/ . 

By substituting (26b), (35), and (8) into (3), together with some 
algebraic manipulation, it can be shown that the power constraints 
in (3) can be expressed as: 



\)P, = B, - £xk, , I = 0, 1, ••• , L 



where 



B, = J [TMif)) 1 



N,. 



J T 



A,l/-f 



w = a,,, - j 



tf / + 1 (/ - f )J [*.„(; 



df, 



'-! 



(38) 



(39) 



Othl = 



>!/-| 



-Ml - f 



rf/, m t (R r . (40) 



Clearly, if and (R/ are known, 0, , a M , and (X,)* can be computed, 
the validity conditions in (36) and (37) can be checked, and the filter 
characteristics can be computed from (35), (8), and (9). Thus, the 
optimization problem is reduced to that of determining the 3 and (R/ 
which minimize the mean-square error 8 in (30), subject to the power 
constraints in (38) to (40) and the validity conditions in (36) and (37). 

6.1. Mean-Square Error versus (R f 

Before a design procedure can be proposed, it is necessary to under- 
stand the relationships among 8, 3, and (R f . Such are the subjects of 
this section and the next, and Section 6.3 gives a simple design procedure 
based on the results. 
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From (30) and (39), the mean-square error can be written as 
8 = m - f TM(J) df + Z XJ/3, . 

J* 1-0 

From the definition of M (/) in (2), it is easily shown that 

TM(1) dj = Too . 

-1/2 7' 

From (41) and (42), we may decompose £ into 

8 = S, 4- 8 2 



where 



and 



/1/2T ~ 

TM(f) df - TM® dj 
-1/27' Ja 



S 2 = £ \}/3, . 



(41) 

(42) 

(43) 
(44) 

(45) 



Since T and M({) are given, 8i depends on £f, but not on the integer 
in (R/ . Therefore, for any 3, the integer in (R/ must be chosen to minimize 
S a subject to the power constraints in (38) and (40) and the validity 
conditions in (36) and (37). 
If we define 



A = 






-»L 



5 = 



3l. 



(46) 



Q = 



a i Pi + a lt 






(47) 



L a 0L a 1L P L + a £t _ 

then the power constraints in (38) take the compact form 

QA - 
and (45) becomes 

Sj = A'(5 = A'QA. 



(48) 
(49) 
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It can be shown that Q is positive definite; hence, Q -1 exists and 
we may combine (48) and (49) to obtain 

8 2 = g'A = 3'Q _, 5- ( 5 °) 

For each /, one may choose m to minimize the ratios 

[#,*,(/- m/T)f/\A l (J-m/T)\, 

When this is done, /3 t and a hl decrease — see (39) and (40) — and the 
elements of (3 and Q decrease — see (46) and (47) . However, it is difficult 
to see from (50) whether S 2 would decrease or increase (the elements 
of (5 and Q decrease, but the elements of Q" 1 may increase). 

We resolve this difficulty by first considering the increment in 8 2 
resulting from arbitrary changes in the ratios 

[*.«(/ - !)]' 

I 7 Ti • 1-0.....L. 

\ A J m \\ 

I A 'V - f) I 

For brevity, we use the abbreviations 

[>■♦■(' " f)J 

Ci(D = h 7 i T gL , 1 = 0, ■••,L; mtfll,. (51) 



Ay - 1 

Let r,(/) denote the increment in C,(/), Z = 0, • • • , L. The resulting 
increments in X) , 8 2 , A, (5, and Q are denoted, respectively, by Aj , 
d, A, (5, and Q. 

Notice that the increments r,(/), I = 0, • • • , L, are not necessarily 
small. 

Replacing Q, A, (3, and S 2 , by (Q + Q), (A + A), (0 + (5), and 
8 2 + d, respectively, one has from (48) and (49) 

(Q + Q)(A + A) = ? + $ (52) 

8 2 + d = (A + A)'(? + 5). (53) 



From (52) and (48) 
From (53) and (49) 



QA = g - QA - QA. (54) 

d = A'i 4- A'g + A'?. (55) 
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Multiplying (48) by A', transposing A'QA in the resulting equation, 
noting that Q is symmetric, and using (54), one obtains 

A'(5 = A'jjj - A'QA - A'QA. (56) 

Substituting (56) into (55) gives 

d = A'jji + JJJ'(A + A) - A'Q(A + A). (57) 

By the definitions of (Hi and a M in (39) and (40) , and by the defini- 
tions of the increments, one can show after some manipulation that 



A'Q(A + A) = 2 M + A *] f 

h - J a 



h-0 >>3 _ 1-0 



I. 



r,.(/) dj 



E xtd(/) 

1=0 

+ E xt f j E [xJ + aj[c»(/) + i\(fl]fr,(/) d/ (58) 

(-0 «>!» Ia-0 J 

S'(A + A) = E [Xt + A,] f [TM(j)]*r,(f) df (59) 

1=0 J 8 

a'S = E x* ( [riif(/)]*r,(/) d/. (60) 

1=0 •'ll 

We are looking for a condition to determine the sign of d. We must 
decompose or combine the terms in such a way that the condition, if 
it exists, can be detected. This is done by substituting (58) to (60) 
into (57) and casting the resulting equation in the following form: 



d = E [X! + A A ] f \[TM(m h - E xfCi(/)k(/) df 

A-o Ja \ i-o ) 

+ E xl ( \[TM(fi\* - E [x! + a,][C,(/) + r,(/)]}r„(/) #. (6i) 

h=o Ja \ i=o y 

From (61) we can prove a theorem about the selection of (R, for any 
given <f. 

It has been shown after (35) that the solution of the optimization 
problem is valid only when (36) and (37) are satisfied. From the defini- 
tion of C,(/) in (51), (36) can be written as 

/)(/) = [TMiStf - E XtC,0) ^ 0, for /, g. (36) 

1=0 

For any given d, let us define: 

{(R f }s = the set of all the choices of (R f 

which, together with the given 3, 

satisfy (36) and (37). (62) 
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We have assumed that (31) or (32) holds for all I; therefore, there is a 
choice of 01/ in {(ft,},, which simultaneously minimizes Cj(/), I = 0, ■ ■ • , L. 
For later use, let us define: 

(R/,3 = the Si r in [Qi f } 3 which minimizes C ( (/), I = 0, ■ ■ • , L. (63) 

If we change Q\ f from (R /ifl to (R/, 3 , which is also in ((ft/Jo , C t (f) will 
be increased, say, from C t (f) to C,(/) + r,(/), where 

r,(/) ^ 0, I = 0, ••• , L. 

We have shown that if C,(/) is increased to C t (f) + r,(/), Z = 0, • • • , L, 
8 2 is changed to S 2 + d, where d is given in (61). Since (R /ifl is in {(R/} s , 
(36) and (37) are satisfied. Since (R/, 9 is also in {Si f } s , (36) and (37) 
are again satisfied, but in the form 

[TM(f)] h - £ [X? + A,][C,(/) + r,(/)] ^ 0, for /, d 

1=0 

and 

Xj + A, > 0, I = 0, ■■■ ,L 

because C t (j) is increased to [C',(/) + I\(/)] and (\ z )* is changed to 
[(^i)* + A|]. Substituting (36), (37), and the two inequalities above 
into (61) shows that 

d > 0. 

Therefore, S 2 and S increase when (R r-! , is chosen instead of (R/.„ (Si 
is fixed for a given if). This proves: 

Theorem 1: For any given 3, the mean-square error 8 is minimized by 
selecting (R,, fl in {6i f } 3 . 

Clearly, (R r . fl is the optimum (R, for the given if because it minimizes 
the mean-square S, subject to the power constraints in (38) to (40) 
and the validity conditions in (36) and (37). 

6.2 Mean-Square Error versus 6 

We now consider the variation in the mean-square error when a set 
of frequencies is deleted from a given d. Let us define a frequency set 
3 as 

3 = \f ' ~^f ^ / ^ ~pp and Q\ f is an empty sew- 
Clearly, if H 3 ' s an empty set and if U g is the frequency set — 1/27 7 fS 
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/ ^ 1/2 T. Equation (43) can be written as 

8 = f TMiJ) df + A'&. (64) 

Let ft be a set of frequencies in 3. By deleting 12 from 3 we mean that 
(R r is changed to an empty set for / e ft, but remains unchanged for 
/ i ft. When ft is deleted from 3 (that is, when 3 is changed to 3 — ft), 
& Q, A, g, (X,)*, and 8 are changed to (<J + ft), (Q - Q), (A - A), 
(5 — (?)> [( A 0* ~" Aj]> and (8 + e), respectively. Equation (64) is 
changed to the form 

8 + e = f TM(f) df + (A - A)'(g - J). (65) 

Since ft C ^ and fl 8 is an empty set, ft f| cJ is an empty set. From this 
we may subtract (64) from (65) and obtain 

e = f TM(j) dj - A'g - A'0 + A'g. (66) 

It is seen from (48) that 

A'g = A'QA. (67) 

When 3 is changed to 3 — ft, (48) is changed to 

(Q - Q)(A - A) = - (3. (68) 

Subtracting (48) from (68) and combining the resulting equation with 
(67) yields 

A'g = A'g - A'QA + A'QA. (69) 

Substituting (69) into (66) gives 

e = f TM(f) df - A'g - (A - A)'g + A'Q(A - A). (70) 

The ith. element of the vector jjj is 

f ITMWfC^to df. 

Jn 

The ith. element of the vector A is A,_ t . The element in the ith row 
and the jth column of Q is 



f cuncuf) df. 
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Using these element values, it can be shown from (70) that 

e = J \[TM(m* ~ Z CXI - *dC t WfiWM<fi? - g X!C,(/)| df. 

(71) 

We have shown in Theorem 1 that C t (f) should be minimized. Thus, 
(R r should be selected to avoid those frequencies where C t (f) = » 
(for instance, where discrete tone interferences exist). Furthermore, 
the validity conditions in (36) and (37) cannot be satisfied at such 
frequencies. Therefore, we may assume, without loss of generality, 
that C,(/) 5^ oo for the given (R, . The variation in (X,)*, A, , then 
approaches zero when the variation in S, ft, approaches zero. There- 
fore, if ft is replaced by an infinitesimal frequency set 0, A ( becomes 
negligible and (71) becomes 

e = J llTMVrf ~ Z xtC,(/)} 2 df. (72) 

We have defined in (36) the abbreviation 

D(l) = [TM(j)] h - Extafl). ( 73 ) 

It is seen from (71) that if 

D(f) = 0, for all / t ft, (74) 

then e is zero and 8 is unchanged when Q, is deleted from 6. 

If D(j) t* for some / e ft, there is, in ft, an infinitesimal frequency 
set 6 in which D(j) ^ 0. If is deleted from d, e is given by (72). The 
integrand of (72) is [Z>(/)] 2 and is positive; therefore, when e is deleted 
from d, e > 0, and 8 increases. Repeating the deleting process we see 
that 8 can only increase when any frequency set ft is deleted from $ 
and D(j) ^ for some /eft. 

The above proves the theorem: 

Theorem 2: For any given $ and (R, which may or may not satisfy the 
validity conditions in (36) and (37), and for any ft C 3, deleting ft jrom 
<J will not change the mean-square error 8 i] D(j) = for all /eft, and 
will increase 8 if D(j) ^ jor some /eft. 

6.3 A Design Procedure 

The ambiguity in (50) is resolved in Section 6.1. It is proven in 
Theorem 1 that, for any given 6, the <R f which minimizes C t (j), I = 
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0, • • • , L, is the optimum choice among all the solutions of (R/ which 
satisfy the validity conditions and power constraints. Theorem 2 shows 
that deleting a frequency set SI from a given d will increase or not change 
the mean-square error (never decrease). It is clear from these results 
that, in searching for the optimum d and 6i f , one should begin with 
the largest possible <f and with the <R r which minimizes C t (f), I = 0, 
• • • , L. From the definition of £f in (27), the largest possible d is seen 
to be 

■" = fi^4l' (75) 

Thus, we can propose the following simple design procedure: 

Choose d = £f mnx . For each / in d max , choose the (R, which minimizes 
Ci(j), I - 0, • • • , L. Compute 0, , a hl , and (X,)* from (39), (40), and 
(48), respectively. If the resulting values of (X,)* satisfy the validity 
conditions in (36) and (37), the above choice of & and (R, is optimum. 
The power constraints are satisfied by computing (X,)* from (48). 
The mean-square error 8 is minimized. 

Increasing C,(/) or deleting some frequencies from d m&% will increase 8. 
See Theorems 1 and 2. 

The optimum filter amplitude characteristics are given by (35), 
(8), and (9). The over-all phase of the system, 6(f), is given by (24) 
(the system may have an additional time delay) . As discussed previously, 
0(/) may be distributed arbitrarily among the repeaters. The minimum 
mean-square error is given by 

8 = Z xtiSi • 

1=0 

Thus closed form results are obtained if the choices of d and (R, in 
the above design procedure satisfies the validity conditions in (36) 
and (37). As illustrated by the applications in Part II, such validity 
conditions are usually satisfied under normal operating conditions. 2 

VII. CONCLUSION 

The joint optimization problem is solved in closed form for deter- 
ministic sampling under two conditions: 

(i) The pass and attenuation bands of the transmission media must 
coincide: (31) or (32) holds for all I. This is usually the case, because 
similar transmission media are usually used. Moreover, carrier modu- 
lation can and should be used at the repeaters to shift the frequencies 
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so that the pass and attenuation bands coincide and the transmission 
media are best used. 

(it) The validity conditions in (36) and (37) must be satisfied (see 
Section 6.3). As illustrated in applications in Part II, such conditions 
are usually satisfied. 2 

The closed-form expressions for the optimum repeater character- 
istics and the minimum mean-square error can be computed using the 
procedure in Section 6.3. 

Two theorems are proven in Section VI for resolving the ambiguity 
in the selection of the transmission band. These theorems hold regard- 
less of the second condition above. 

Timing error is also considered. It is shown that in the transmission 
band, the jth analog repeater (j = 1, . . . , L) should have an ampli- 
tude characteristic proportional to the given function (see Fig. 1). 



. N,(f) J 



1 



.1 AUM,(1) 



j- 



This simple specification holds regardless of the timing jitter distri- 
bution, the message sequence spectral density, and the two conditions 
above. These conclusions are deduced from this result: 

(i) Since the above given function is in general well-behaved, and 
since the analog repeaters may have arbitrary phases, the optimum 
analog repeaters can be closely realized. 

(u) It is not only economical, but also optimum, to use identical 
analog repeaters (which may have different gain factors) in many 
systems where the repeater noise spectral densities differ only by 
multiplicative constants (but are not necessarily flat with frequency), 
and the amplitude characteristics of the transmission media differ 
only by gain constants. 

(Hi) If the repeater noise spectral densities differ only by multipli- 
cative constants (and are not necessarily white) , each analog repeater 
will be required to provide amplitude equalization for its adjacent 
transmission media (with arbitrary phase equalization). This specifi- 
cation for digital transmission is the same as the requirement for 
analog repeaters in a voice system. 1 Thus, by installing a digital as 
well as an analog repeater at the (L+l)th repeater location, a hybrid 
system can be used for either digital or voice transmission without 
changing the L analog repeaters between. 
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